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ABSTRACT 

In the Multi'Disciplinary Graduate Program in 
Educational Research^ graduate students at the doctoral level were 
participants. This program required exposure to other disciplines^ to 
various approaches to problem definition, to various methodologies^ 
concepts, and research techniques. It vas expected that the students 
had gained experiences and acquired competencies within their 
individual disciplines. The subject of education research wais chosen 
as being broad enough in scope to encompass other disciplines and to 
aid the students in their explorations in their own fields. In the 
group participating in the program the following disciplines were 
represented: information sciences, clinical psychology, economics, 
social psychology, pediatric psychology, counselor education, 
educational anthropology, sociology, educational psychology, and 
educational research. Under the guidance of experienced leaders, 
seminars were conducted; guest speakers contributed on different 
subjects; and there was frequent informal interchange between 
participants. Many students found that they gained an understanding 
of the strengths and limitations of their own discipline as well as 
those of other disciplines. At a future date the data collected from 
this program will be analysed, evaluated, and published. The 
methodology involved will be included for guidance of those who may 
wish to conduct a similar program. (JD). 
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EVALUATION 



One of the potentially valuable spin-off products of the Multi-dis- 
ciplinary Program in Educational Research at the University of Pittsburgh 
has been the interest generated among university administrators and fac - 
ulty members in the possibility of developing new evaluative measures 
for programs in higher education. The idea of bringing together persons 
who were experts in evaluative technology with hximanists from a variety 
of disciplines was initiated in order to evaluate our own program. It was 
recognized that although philosophers, literary critics and some social 
scientists do not necessarily use the term evaluation, their activities may 
be considered relevant to evaluation of complex programs. Although our 
program was terminated before the outcomes of this approach were avail- 
able, a number of the participants will continue this activity. The poten- 
tial of this enterprise has been recognized by administrators responsible 
for the academic programs within the university. The insights that may 
be gained from this endeavor could have applicability to education that 
would allow us to go beyond the evaluation/technology now available.^ 

While this more intellectually sophisticated approach to evalua- 
tion is being developed, more tra.ditional evaluation has been conducted. 
Since we were simultaneously conducting a program and developing mate- 
rials for dissemination, evaluation was es^pected to both provide feedback 
to improve the program as it was being conducted and to suggest how future 
programs could take advantage of our experiences with processes and our 
products. 

Evaluation has been a continuous process throughout the conduct 
of the program and evaluative feedback became a basis for revision* There 
were several types of evaluative measures used. 

4 - 
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I. Decision Recording and Asse ssing: 

A record was kept on decisions that were made so that the conse- 
quences of these decisions could be reflected upon. This technique has 
some definite advantages for evaluaHng complex programs. Incremental 
and precedent- setting decisions are often made without a conscious aware- 
ness that a decision is being made that may stiape the future program. 
Having someone assigned to the task of recording decisions heightens 
awareness of these decisions. All decisions liave intended consequences 
but there are often tmanticipated consequences as v/eil that may be advan- 
tageous or dysfunctional. In complex programs at the graduate level, 
there are not simple causal chains but complicated networks of multiple 
.causes and intervening variables. In an on-going educational or social 
change program, decisions cannot be retracted readily and the social 
experiment started over again. A conscious awareness of the impact 
that decisions appear to be having allows new decisions to be made^ in 
order to capitalize on what is having positive effects or modify plans that 
appear undesirable. 

Although the process of decision-making is more important for a 
program as it is underway than documentation of these is for others, crit- 
ical decisions have been written up that may be of some benefit to others 
in designing programs. 

Innovative programs are initiated by ^people wht) l}eliev(:' that some 
goals are not being attained by means of traditional programs or that si^r- 
nificantly better means can be developed for attaining existing goals. In 
our case, it was believed that the traditional structure of universities 
meant that people in various behavioral and social science disciplines 
who might have an interest in educational research were isolated from 
one another. This meant that for graduate students wishing to pursue a 
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doctoral dissertation applying their disciplines to education, it was diffi- 
cult to locate committee members who would be supportive and knowledge- 
able as advisors. For faculty members interested in conducting research 
in the field of education, there was no forum for discussing their ideas 
and interacting with facility from other departments or the School of Edu- 
cation who might stimulate their research on significant educational prob- - 
lems. From the perspective of the program's directors, the program 
goals included more than the encouragement to apply various academic 
disciplines to education. The program was to expose members of each 
discipline to the contributions of other disciplines and to the criticisms 
and suggestions'^for their own research that might be. made on the basis 
of alternative frames of reference. This would require that they expli^ 
cate the assumptions and intuitions on which they based their research 
and become consciously aware of the strengths and limitations of their 
methodology. This was thought to be prerequisite to collaboration whether 
that collaboration across disciplinary boundaries manifested itself in per- 
sons working together on a particular problem or a person working alone 
but borrowing theories and methods that had been developed by other dis- 
ciplines. 

The first decision that had to be made in order to get the program 
operating was the method to be used for recruiting and selecting candi - 
dates > A number of alternatives were considered before a decision was 
reached. Some of the faculty members thought that a desirable strategy 
would be to select a specific topic and recruit students who would apply 
their discipline to it. This approach had been used before at the Univer- 
sity of Chicago when the "problem'' selected was a geographical area. 
Members of numerous disciplines conducted research. Although a great 
deal of knowledge about this one area resulted, this approach does not 
necessarily stimulate collaboration across disciplinary boundaries. Too 
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often, the results are discrete studies that do not fit together for more 
comprehensive understanding of problems or problem prevention. 

In using a common problem approach, the topic must be sxifficiently 
broad so that the members of the disciplines represented can define a 
problem to which they can contribute. Generally what results is that the 
topic does not represent a common problem but an entity manifesting mul- 
tiple problems that are then independently researched. There was a prac- 
tical concern with using this approach. If a topic was to be identified and 
students selected on the basis of their willingness to apply their discipline 
to it, rather extensive information would have to be supplied. It seemed 
unlikely that graduate students and their sponsoring faculty would feel 
confident that an appropriate dissertation topic could be ensured on this 
basis. It was also considered possible that the descriptive details of the 
topic selected might constrain the way in which persons would view educa- 
tion and define research problems. 

The alternative decided upon was to have students submit disser- 
tation proposals for research on educational problems. This was seen as 
having potential to generate more interest in the program. Students and 
faculty sponsors would have the opportunity to pursue research of inter- 
e5?t to them. Because they would not have a perception of education im- 
posed on them by the program, their perception of education and their 
definition of educational problems had the potential for making a new con- 
tribution. It was recognized that students, V/ho had received the approval 
of their advisor for the research propos,ed and who had been selected by 
the program on the basis of the quality of their proposal, might resist 
the influence of the program. Students who were committed to completing 
dissertation research might view the program as supporting that endeavor 
and be unwilling to participate in new learning that would prolong that 
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research or distract them from their personal progress toward their doc- 
toral degree* 

It was explained to students that the program's staff had goals to 
be attained and that they would be required to contribute to this goal attain- 
ment. The Multi-disciplinary Program was to be a program and not merely 
a procedure for supporting the independent progress of individual students 
seeking doctoral research opportunities. Each student was expected to be 
a representative of his discipline and bring the theoretical and methodol- 
ogical expertise that he had acquired to bear on the discussions. Only by 
the active participation of all could studenfs^e exposed to the various 
perspectives of the disciplines represented. Unless intellectually stimu- 
lating exchanges occurred across disciplinary divisions on the topics of 
discussion, there would be no advantage in conducting a program as opposed 
to providing fellowships for students who remained in the social and intel- 
lectual climate of their own department. Students were expected to con- 
tinue their progress in their own departments and in addition to progress 
in their ability to address an aud?ance of persons in other disciplines and 
be receptive to the criticisms and suggetitjons from others that could en- 
hance the significance of their own research. 

Because the program was planned for doctoral level students, the 
assumption was made that students should be engaged in research that 
would lead to a completed thesis. Therefore the alternatives considered 
were restricted to whether the student should define the problem and pro- 
pose the research as a criterion of admission or whether the program 
staff should select a broad problem or entity on which all candidates would 
be required to conduct research. 

A development which occurred during the second year at the time 
Pau Lazarsfeld assumed the directorship suggests another alternative 



8 



6 



that could be considered. Under Lazarsfeld's guidance the emphasis on 
process continued but was supplemented with a concern for materif.ls^ pro- 
duction. These materials would be of two types. The first wa3 to develop 
instructional materials that would serve the needs of our program and be 
made available for future programs. These wo\ild utilize e:d.sting knowl- 
edge but would organize it in appropriate pedagogical form so that students 
could acquire both skills and substantive knowledge about educational prob- 
lems and research. The second type was to actually produce new knowledge 
that seemed necessary for an effective multi-disciplinary program in edu- 
cational research. The latter tasks could only be accomplished by expand- 
ing the professional staff and involving students in' the actual production 
of this knowledge. Therefore students were recruited specifically to un- 
dertake directed research. 

These students attended the seminars but in lieu of doing doctoral 
research were given projects as defined and directed by the staff members. 
They participated as members of their respective disciplines in the semi- 
nars and quickly became integrated into the on-going program. The pro- 
cess of integration appeared to be enhanced by their identification and 
regular working relationship with the staff members. In the feedback ses- 
sions from students, it seemed evident that these students were benefiting 
from the entire program as much or possibly even more than the first 
year students. Some of the first year students volunteered to take on 
small directed research tasks in addition to^their own research and semi- 
nar participation in order to acquire the opportunity to work closely with 
the professional staff. It seems probable that had the program continued, 
the second year students would have defined a problem for doctoral research 
after a period of directed research and participation in the program. The 
influence of the program might have then been reflected in the problem 
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definition and research design. This poses another alternative that could 
be considered in conducting a multi-disciplinary graduate program. Stu- 
dents might benefit from an introductory period in which they utilized the 
materials produced by our programs and simultaneously conducted research 
that was assigned and directed. Students having satisfactorily accomplished 
their directed research could then be given the opportunity to define their 
own problem for doctoral research. 

During the first year, various strategies were used to foster group 
cohesion. A graduate student room was provided by LRDC so that students 
could share common facilities and interact informally with one another. 
Weekly brown bag luncheons were instituted with staff members partici- 
pating so that instructional discussions could be encouraged. Faculty 
sponsors were invited and Center members were asked to stop in and talk 
with students. Social occasions were arranged. While these strategies 
appeared to be reasonably successful, it soon became evident that effec- 
tive collaboration, peer tutoring and knowledge exchanges occurred most 
readily among those students who worked regularly in the graduate room. 
The regular use of the room depended largely upon the phase student 
research.. Those who were gathering data, using computers for data ma- 
nipulation or undertaking library research spent little time at the desks 
that were available. The necessity of working at some other location much 
of the time tended to reduce the probability that they would use the student 
room even when the facilities were adequate for the task at hand. They 
would stop in to confer on occasion or to continue a discussion stimulated 
by a seminar. 

The second year students who met regularly with the staff members 
in their directed research made greater use of the program facilities that 
were conveniently situated next door to staff offices. Their cohesion was 
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directly stimulated by the tasks they were doing and special strategies to 
foster group cohesion and integration of members were unnecessary. . 
Students who voluntarily took on a task for one of the directed projects 
tended to remain in close contact with the others who were involved in 
that project. 

Some of the students during the first year complained that they were 
not involved in prog:r am planning to the' extent that they wished to be. The 
focal issue became the selection of guest speakers. The staff proposed 
that they form committees that would assume initintive and responsibility 
for general planning or planning of specific components. The committee 
to select guest speakers did pro\-ide an opportunity for group effort and was 
encouraged by the staff. Although some of the students felt strongly that 
it was their program and that they should determine their needs and help 
design ways of meeting these needs, there was a limited responsibility 
assumed. Assistance from the staff was required to follow through on the 
plans they initiated. Other students held quite the opposite attitude. They 
felt that they gained more fi'om staff planned seminars and experiences. 
They felt that the staff members had program goals and that attempts by 
other students to insist on democratic participation tended to \indermine 
goal attainment. 

Tensions were managed by explaining to students that the funding 
for the program was not given merely for support of participants in an 
on-going program but in order to develop transportable programs, in- 
cluding materials. Students were free to give reactions or inputs and 
these syere solicited by the staff in order to improve program objectives, 
processes and materials. Their active participation in planning was wel- 
come provided that they were willing to assume the responsibility for 
helping to carry out the decisions and didn^t merely wish to complain 
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about the decisions of others or make decisions that others would have 
effect. Quite open and frank discussions ensued in which students sug- 
gested that they had come through the era of student activism where "rele- 
vancy^' of educational experiences and "doing your own thing" were popu- 
lar slogans. Most of them were disillusioned with the ability of their 
peers to define what was relevant and felt more confident of the decisions 
made by faculty members who had broacjer experiences, expertise and 
legitimate criteria for relevancy. They now sought and respected respon- 
sive leadership. A rather general consensus formed that the students 
had reacted* against the authoritarian structure of education and that they 
had gone to the other extreme demanding that they set the goals and ob-- 
jectives of their own education and that faculty members struggle to find 
the means to meet their objectives. Most of them now took the position 
that it was their responsibility to direct their own learning by taking ad- 
vantage of the opportunities that were offered. In an integrated program 
such as Multi-D, it was ideal to have a responsive leader who was capable 
of bringing a wealth of knowledge and experience, to any issue raised. 
However, graduate students ought not to expect that any program will be 
comprehensive enough to cover all the needs of all of the students. There- 
fore students ought to take advantage of what is offered and search them- 
selves for any additional knowledge or skill development they might re- 
quire. If the program leaders can responsively and responsibly include 
additional objectives defined on the basis of, student articulated needs or 
desires, the students were fortunate. 

In the student interviews at the conclusion of the program, students 
suggested that an unexpected outcome of the program was the self-assur- 
ance that some of them gained through being treated as professionals. 
This allowed them to take a more active role in directing their own learning. 
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searching for the answers to their own p'^roblems and interacting with 
faculty members both within the program and outside of it. 

II, Product Evaluation ; ' 

The products themselves were continuously tried out with our stu- ■ 
dents and revised. They were, also given to (^ther faculty members for 
professional review. The interest generated in some of the new materials 
that were developed was manifc sted in requests for these materials for 
other programs. The units on "Quantification as Language" and the ac- 
companying exercises have been used for courses in the Sociology Depart- 
ment and are currently being pilot tested in the Graduate School of Social 
Work, The Qualitative Methodology has been reviewed by numerous mem- 
bers of the Anthropology Departrxient and the Educational Anthropology 
group within the School of Education. This unit is an attempt to produce 
new knowledge that is lacking in the available literature. The faculty 
members from Anthropology who have reviewed it at various stages have 
been subsequently interviewed by Alice Troup. They have been most en- 
couraging and have generously offered suggestions that can be used in its 
further improvement. This unit is not, as yet, in final form and will be 
revised before submitting it for publication. 

The Frame of Reference study stimulated interest when it was 
presented as an on-going study and process at the AERA meetings. It 
has become a topic of discussion at formal and informal meetings. Its 
potential contribution to the Sociology of Knowledge has been recognized 
and many requests for copies of the working papers have been received. 
The concept frames of reference, the methodology devised for explicating 
various professional reference frames and the use of such a study in a 
graduate program which prepares students for collaborative, problem- 
centered research has generated extensive enthusiasm. This has reinforced 
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our perception that the study does produce knowledge for which there 
exists a need. Although our own program exposed the students to the on- 
going study itself, we intend to analyze the data collected and prepare 
the materials for publication. Each step of this study has been subjected 
to peer review. The comr' al serve as an alternative to the 

instructional strategies i; .o ..n students. The published o- 

rials will lack the stimulation tuat was offered to our students through 
the opportunity to meet the experts being interviewed and hear first hand 
their responses to the issues raised. It will, however, offer certain ad- 
vantc.ges in that the data will have been analyzed and the expert partici- 
pants themselves will have reviewed the materials. The methodology 
will be included so that others may conduct their own interviews and repli- 
cate the experiences of our students should they wish to supplement the 
explication of reference frames that we have been able to do. 

III. Participant Review of Pro cesses: 

Some seminar meetings were specifically devoted to discussion 
of the processes that had been used and the planning for the future. Staff 
members were available to interact with the students on a regular basis. 
If students did not initiate meetings to offer their reactions, the associate 
director would invite them to stop in for a chat in order to elicit responses. 

IV. Evaluative Technique Used at the Conclusion of the Program ; 

In evaluating any educational program from preschool through to 
graduate level, the significant outcomes cannot be assessed adequately 
as the student completes the program of study. When very specific in- 
structional objectives can be articulated, we may measure in-coming and 
out-going competencies and with sophisticated evaluative techniques feel 
reasonably sure of the part played by the educational program in the 
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progress of students. What is more problematic is whether the student 
will use these competencies now available for his own purposes and for 
his various roles in our society. Early educational programs thait are 
conducted within the formally required years of schooling have the ad- 
vantage that longitudinal, follow-up studies can be attempted as well as 
comparative studies on matchec' ;ro\n^ 

At the graduate level, the rn. of competencies that students have 
as they enter the program is both broad and differentiated. Since stu- 
dents in our program continued to meet the educational course require- 
ments within their own department, out- going competencies would reflect 
the professional growth fostered by the departmental program as well as 
the Multi-D Program. In a multi-disciplinary program, the expectation 
is that they will have gained experiences and acquired competencies that 
supplement their education within their discipline. These competencies 
will be reflected, if the'program has been successful, in their attitudes, 
the quality of their future research, and the increase in the range of 
theoretical and methodological expertise they can draw upon. 

A multi- disciplinary program requires exposure to other discif. 
plines, to various approaches to problem definition, to various methodo- 
logies, concepts, and research techniques. This is accomplished through 
group experiences and an inevitable tension exists because adapting to 
the individual differences becomes much more problematic. During the 
conduct of our program, we attempted to ensure sufficient variation to 
meet the diverse needs of ail of our students. Not all students would 
profit equally from any one seminar but we hoped that all students would 
be gaining new experiences, skills, and knowledge during most of them. 

At the conclusion of the program, the students were interviewed 
in small groups. Questions were asked not only to elicit individual 
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responses but to stimulate discussion and reflection. One of the objec- 
tives of the program had been to develop the student *s ability to be con- 
structively critical. Each student had exposed his own research design, 
methodology and r'esear^ch programs to critical review by the participants. 
It seemed reasonable and just to provide an opportunity to apply construc- 
tive criticism to the program itself. 

There were a advantages to be gained in having me conduct 
these interviews student support had been terminated, there 

were no further ci. .vards to be offered and, therefore, no incentive 

for constraining opinions, attitudes and criticisms. At most, the stu- 
dents could hope for letters of recommendation and assistance in locating 
job opportunities. These requests were more profitably directed to Paul 
Lazarsfeld. Although I had had the role of associate program director, 
and this formal differentiation had been acknowledged and respected by 
the students, I had participated and profited by my involvement in many 
respects as a peer. I had presented my own doctoral research and had 
interacted frequently as a member of the group from the discipline of soci- 
ology. My full time commitment to the program had made me easily acces- 
sible and a rather informal rapport v/ith the students had been established. 
The interviews seemed likely to elicit frank and open discussion. 

The first interview question was what was your motivation initially 
in applying to Multi-D? With the first group of students, the immediate 
response was hesitant laughter from one student who frankly admitted 
that the student support had attracted him. The discussion that ensued 
revealed some interesting data. All of the students had had some form 
of student support at the time they applied. There was no appreciable 
difference in the amount of the stipend provided by Multi-D and that which 
they would have received from other sources although several mentioned 
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that the 12 month basis was appreciated and utilized by them at advanced 
levels. Those who held teaching assistantships pointed out that to receive 
a stipend for learning and pursuing doctoral research had distinct ad- 
vantages over teaching assistantships. Although the students valued their 
teaching experiences, they felt that the tasks of teaching assistantships 
were time-consuming arid tended to impede their progress in completing 
doctoral requirements. Students generally agreed that gra.duate students 
do profit by teach^'nfr assistantships as part of the graduate experience but 
that r ' '^rm or two, very little ««iore is gained for the effort 

requirea. Students who had been receiving scholarships from various 
sources that demanded nothing other than continuing progress on the part 
of the students appreciated the freedom to direct their own studies and 
research but felt in need of a more structured environment. The appeal 
of the Multi-D Program was that it offered structured opportunities for 
learning and research while allowing sufficient freedom in terms of per- 
sonal professional goal attainment. 

Students were asked what their persor oals or expectations had 
been waen they entered the pr^o gram. One stu : asserted that he had 
had a ^-erry narrow and specific goal of complet., y his Ph.D. He had done 
so, ha-i:^ppreciated the opportunity provided by e program, had learned 
how ot:.ers define problems and conduct res ear: and had become more 
generally interested in education as a phenomenon for research. . He had 
utilized concepts and methods borrowed from other disciplines success- 
fully in his research and had profited by discussions with qualitative 
researchers. He was to assume an assistant professorship in an academic 
department of his own discipline in another unrrersity. Whether or not 
he pixrs"aed further educatioiral research would depend on the availability 
of resazrch support and approval within his department. He would prob- 
ably and welcome such support and, if given the opportunity would 
teach ?c ' Durse on the application of his discipline to educational problems. 

17 
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Other students had goals which included both an interest in pur- 
suing educational research and becoming exposed to students and faculty 
members from other departments who shared this interest. Some stu- 
dents who had already chosen to do a doctoral thesis involving an educa- 
tional problem before the program was announced found it difficult to 
set up a committee of faculty members who were enthusiastic about the 
topic. Even when this was accomplished there was a problem locating 
a departmental member who had much knowledge about the field of edu- 
cation. Faculty member j willing to become major advisors frequently 
had more enthusiasixi than experience in the area of educational research. 
The announcement of the program was seen by both students and faculty 
members as an opportunity to overcome the lack of substantive knowledge 
about education and educational research. The establishment of a special 
program t"^ .dp_ people in educational research gave a legitimacy to the 
pursuit an Tipr*=:ssed some iaculty members who might otherwd.se have 
considered i an undesirable area for problem definition. 

Amcri_z ^mrrr.er group of students interviewed, a student said that 
the chairmarr_ nsf called together a group of graduate students whom he 
thought migir±: ite intrere sted in the program at the time the announcement 
was receiv*-uL Tli^ student commented that because student support op- 
portunities .'.re 2i: .'^ely sought by his department, it frankly wouldn^ 
have surpr^i edl him if the meeting was to generate enthusiasm for astro- 
physics. 5%}me'v-hat to his amazement the area, of research was to be 
eciucation, -a:- ir.r crest he had long had. He -ealized that the cnairman 
himself had -^i interest in education and the -:udent felt himself fortunate 
to have been z:^ec to the meeting. Later di. cussions with the ether 
students frcmTnis department revealed that they too had had sorie active 
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or latent interest in the area which presumably the chairman had been 
aware of and that it was not merely a happy coincidence or an attempt 
merely to enlarge student support opportunities within the department. 

Several students in all of the groups interviewed mentioned their 
need to broaden their contacts. They felt that they were getting over- 
socialized into their discipline. They talked with people in their own 
department, thought like people in their- own department, spoke in a 
disciplinary jargon, gravitated to persons in their own field even after 
the working or studying day. They felt a need to meet people frorn other 
disciplines and exchange intellectual ideas so that they didn't become 
too narrow and unable to communicate with others. 

Other students suggested that perhaps they were inadequately 
socialized. Even after several years in graduate school they weren't 
sure that they were becoming professionals comxnitted to their discipline. 
They had little opportunity to assess what they had learned outside the 
department and its demands. Since graduate students are surrounded by 
graduate peers who have shared the same course experiences and faculty 
members who have even more expertise, attention is focused on what 
you are still incapable of doing rather than the accumulated skills and 
knowledge that you have gained. As one student expressed it, ^'The first 
time that I ever heard myself called an anthropologist was in the Multi-D 
program. When Dr. L.azarsfeld asked me how I, as an anthropologist, 
would view some problem, I felt a mixture of bewilderment, apprehen- 
sion and pride. Many of the ^students agreed that they had had similar 
experiences. They were not accustomed to faculty members treating 
them as serious members of a discipline but rather as students. The 
program influenced their own sense of identity. They discovered what 
knowledge, conceptual approaches, methodological and theoretical 



contributions they could make. As one student put it, "I learned more 
about my discipline and my department from the Multi-D experience 
than I had from my experiences within the department. " This student 
had been doing directed research on one of the methodological units and 
she found that she gained more rapport with the members of her own 
department as she shared with them the work she was doing in Multi-D* 

Many students fouxid that they gained an understanding of the 
strengths and the limitations of their own discipline as well as th-se of 
other disciplines. 

The students were asked to react to the various guest speakers that 
had been invited from our own or other universities. All of the students 
felt that these had baen significant occasions which broadened their own 
knowledg:e of contemporary rersearch in the educational field. These ses- 
sions provided intellectual stimulation well beyond the traditional coUoquia 
series held on the campus because guests were given information on the 
program itself, the disciplines represented among the participants and the 
guidelines used for all presentations. They were permitted to discuss 
their research, design, methodology and results with interruptions by 
students or staff only^ro request clarification on specific points. When 
they had finished their presentation, the staff and students were free to 
challenge, question or criticize the design, underlying assumptions, methods 
or to make suggestions for further research. One guest remarked that 
he hadn^t occupied a "hot scat" like that fof- a long fcime and that it was a 
stimulating, if somewhat exhausting experience; Peter Rossi, who had done 
his own doctoral research at Columbia University while L»azarsfeld was 
the chairman of Ms department, asked if he could iave a second doctoral 
degree for the defense of his res^e2.rch. One of the professors from our 
o^cm university requested the opporttinity to submit another piece of edu- 
crcttional research because he found the criticisms and suggestions so 



2U 



18 



helpful. He was invited back again to do so. The students themselves had 
found it a type of anticipatory socialization since it permitted them to take 
in the role of professional peer. 

Tlie reactions of the students to particular speakers varied consider- 
ably. Invariably the guest considered most enlightening or Stimulating by 
some was perceived by others as well down the list in r^nV order. AlJiougn 
students sometimes ranked members oi their own discipline most highly, 
there was an additional pattern to their responses. They tended to rank 
highly those who shared their preference for qualitative or quantitative 
methodology. They claimed to learn most when the speaker came within 
that preference group butirom another discipline. Some students made 
use of these contacts anisxchanged papers with these guests later or, in 
the case of on- campus gussts, have interacted with them subsequently. 

An unanticipated ciitcome for students was the opportunity provided 
to learm more about the resources on their own campus. Many students 
took formal courses with faculty that they met from outside their own 
department, took courses recommended by other students, became ex- 
posed to additional libraries . consultants, and facilities. The Multi-D 
program served as a meeting ground and clearing house that become 
necessary when the specialisation into various disciplines isolates scholars 
and researchers from one another. 

The assistance offered by the program to the students and faculty 
in gaining access to schools and communities was considered a major 
asset. 

Student Outcomes 

During the course of participating in Multi-D the following students 
received theix. Ph. D. 's. 
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Eugene Rathswohl- -During the first year, hercompleted his thesis 
and became an assistant professor in the Department of Information Sci- 
ences. 

Jake Milliones--M^dwuy th;.o ,gh the second yea , ac comp]e.jKi his 
Ph.D. , became an Assistant Professor in Clijaical Psychology and is now 
the Associate Director of Right Start, a program that works with the fami- 
lies and children from povertri- enviromiients ^predominantly Black but not 
restricted to Blacks) in order :o improve therr educational opportunities 
and attaimnent. 

William DiPietro- -JHe completed his tiesis and received his Ph.D. 
in the last month of the program. He is an Assistant Professor in Econo- 
mics at the University of Baltimore and hopes to obtain research funds to 
continue applying economics to educational problems. 

Daniel Bar-Tal--Completed his Ph.D. in the fall following comple- 
tion of the program and has a post doctoral position at LRDC. He is ap- 
plying Social Psychology to educational problems and is part of a group 
within the LRDC concerned with social contexts of education. 

Joseph Shimron--He completed his Ph.D. immediately following" 
the Multi-D program and has a post doctoral position at the University of 
California, San Diego where he is continuing in educational research. 

The following students are completing their Ph.D. 's with alterna-- 
tive support arrangements: 

Neil Alper--.He is a teaching assistant in the Economics Depart- 
ment and is completing his educational res ear ch* 

Janet Adams--She is working exclusively on her research on edu- 
cational planning in Pennsylvania. She attends meetings at LRDC, keeps 
in contact with LRDC-.rfarrisbar.g developments and ims acted as a consul- 
tant to the Implementation Resesxch at LRDC. 
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Ronald BarreK--He is a research as ^ant in the pediatric- 
psychology pro^ ^ .'niversity of Pitt 

Robert Eckert-- .Vhc i Multi-D was terminated, he took a full-time 
position with a government-affiliated research organization in Washington. 
He is actively involved in some educational evaluation research. 

David Ford^-During the second year, he gave up his student parti- 
cipation and became a Multi-D staff member working with Paul Lazarsfeld 
on Quantitative Methodology. He is currently completing his thesis and 
is applying for positions elsewhere. 

Robert Harchareck--He is working exclusively on his thesis and 

c 

expects to complete his Ph. D. this term. He is actively seeking an edu- 
cational research position. 

Bob Holmes--He changed his field from Social Psychology to Coun- 
selor Education with the intention of becoming a practicing professional 
working with Black students rather than continuing in research. 

Charles Penoi--He interrupted his doctoral research in order to 
assist with the Frames of Reference Study but will complete his compre- 
hensive paper on Follow Through and will probably continue in Implemen- 
tation research. 

Judy Rosen--She was a second year research assistant and did not 
do doctoral research. She has at least temporarily decided to teach in a 
secondary school rather than continue in research. 

Theodora St. Lawrence --'V\^hen the program terminated, she became 
an L.RDC graduate assistaiat in order to complete her anthropological re- 
search at an LRDC developmental school. She has completed her field 
research and is seeking an Assistant Professorship in Anthropology-- 
Education. 
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Carolyn Schumacher --She completed the data compilation for her 
study of the effects of schooling on intergene rational social mobility and 
is writing her thesis. 

John Skvoretz--He is an Assistant Professor in Anthro-Sociology 
Department at the University of South Carolina where he is completing his 
research on the flow of information through a school that is used by school 
paBTSonnel for defining their roles. 

Sally Siciliano--She left the program during its first year when her 
bxrsband entered law school at another university. She planned to continue 
he^v own graduate education in educational psychology. 

Todd Simonds^-He was a first year student in Sociology at the time 
he became graduate research assistant in evaluation. He is continuing his 
graduate education and is undertaking research tasks at the Urban Center. 

Charles Teggatz-^He was a second year research assistant who 
worked with Burkart Holzner on the Frames of Reference Study. He is now 
assistant to Robert Glaser at LRDC where he is heavily involved in educa- 
tional research administration and the editing of materials. 

Francis Terrill--During the second year, he withdrew from Multi-D 
because his program in clinical psychology applied to education problems 
required that he undertake an internship at another site. He has completed 
his Multi-D research, has almost completed an internship in Florida and 
will probably join the Right Start program at the University of Pittsburgh 
when he completes his Ph. D. ' 

Alice Troup- -She was a research assistant in the second year of 
Multi-D who worked with Paul Lazarsfeld on Qualitative Methodology. 
She expects to continue her professional career in educational anthropology 
after her maternity leave. 

Rebecca Wiegers--She has passed her overview in Educational 
Psychology and is completing her thesis applying attribution theory to 
problems of educational achievement 
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